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Abstract. We propose an extension of the framework for discussing the computational 
complexity of problems involving uncountably many objects, such as real numbers, sets and 
functions, that can be represented only through approximation. The key idea is to use 
(a certain class of) string functions as names representing these objects. These are more 
expressive than infinite sequences, which served as names in prior work that formulated 
complexity in more restricted settings. An advantage of using string functions is that we 
can define their size in the way inspired by higher-type complexity theory. This enables us 
to talk about computation on string functions whose time or space is bounded polynomially 
. in the input size, giving rise to more general analogues of the classes P, NP, and PS PACE. 

' We also define NP- and PSPACE-completeness under suitable many-one reductions. 

Because our framework separates machine computation and semantics, it can be applied 
' to problems on sets of interest in analysis once we specify a suitable representation (en- 

coding). As prototype applications, we consider the complexity of functions (operators) on 
real numbers, real sets, and real functions. For example, the task of numerical algorithms 
for solving a certain class of differential equations is naturally viewed as an operator taking 
real functions to real functions. As there was no complexity theory for operators, previous 
, results only stated how complex the solution can be. We now reformulate them and show 

' that the operator itself is polynomial-space complete. 

^ , 1. Introduction 

■ Computable Analysis js], studies problems involving real numbers from the viewpoint 

of computability. Elements of uncountable sets (such as real numbers) are represented by 
O ■ infinite sequences of approximations and processed by Turing machines. This framework is 
ly^ \ applicable not only to the real numbers but also with great generality to other spaces arising 
O ' naturally in mathematical analysis. There is a unified way to discuss computability of real 
functions, sets of real numbers, operators taking real functions as inputs, and so on. 

In contrast, the application of this approach to computational complexity has been limited 
in generality. For example, although there is a widely accepted notion of polynomial-time 
rS ■ computable real functions /: [0, 1] — M on the compact interval that has been studied 
. extensively [l6[, the same approach does not give a nice class of real functions on M. Most 
of the complexity results in computable analysis to date (with a few exceptions 0, HH, [25| ) 
are essentially limited to the complexity of either real functions with compact domain, or 
of bounded subsets of M. They do not address the complexity of, say, an operator F that 
takes real functions /: [0, 1] — ?■ M to another real function F{f). There are many positive 
and negative results about such operators, but typically they are stated in the form 

if / is in the complexity class X, then F{f) is in complexity class Y, and 
there is / in complexity class X such that F{f) is hard for Z. 

More direct statements would be the "uniform" or "constructive" form 

the operator F is in class y, and 
the operator F is Z-haid, 



A short preliminary version of this work was presented at the 42nd ACM Symposium on Theory of 
Computing (STOC 2010). 
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where 3^ and Z are the "higher-order versions" of Y and Z. At the level of computability, it 
is common to ask, as soon as we see a non- uniform result, whether it can be made uniform. 
For complexity, we cannot even ask this question because we do not know how to formulate 



y and Z. This limitation has been widely recognized; see, for example, |14J . pp. 57-58], [25 
and ji, p. 484]. 

To address this problem, we start with the observation (Section [2]) that the aforementioned 
limitation has to do with the fact that traditional formulations of computable analysis do 
not take into account the "size" of the infinite sequences given to the machine as input. We 
then propose (Section [3]) an extension on the machine model by replacing infinite sequences 
by what we call regular functions on strings. An advantage of using these functions is that 
we can define their size in the way suggested by type-two complexity theory jo], [l9|. This 
enables us to measure the growth of running time (or space) in terms of the input size — 
exactly what we do in the usual (type-one) complexity theory. We thus obtain the complexity 
classes analogous to P, NP, PSPACE (and function classes FP and FPSPACE) by bounding 
the time or space by second-order polynomials in the input size. Analogues of many-one 
reductions and NP- and PSPACE-hardness will also be introduced. 

We apply this framework to a few specific problems in analysis by using suitable representa- 
tions of real numbers, real sets, and real functions (Section H]). For real numbers, the induced 



complexity notions turn out to be equivalent to what has been studied by Ko-Friedman [12 



and Hoover j3]. For sets and functions, our approach seems to be the first to provide com- 
plexity notions in a unified manner. This is of particular interest, because many numerical 
problems in the real world are naturally formulated as operators taking sets or functions. 
For example, consider the operator F that finds the solution F{f) of the differential equation 
(of a certain class) given by a function /. As mentioned above, the existing non- uniform 
results jlo|, 13] only tell us how complex the solution F{f) can be when f is easy; precisely, 
they say that if / is polynomial-time computable, F{f) is polynomial-space computable and 
can be polynomial-space hard. But the practical concern for numerical analysis would be 
how hard it is to compute F (i.e., to compute F{f) given /). We formulate and prove the 
first result of this kind: F itself is a polynomial-space complete operator. Our contribution 
is in introducing the framework making such formulations possible. The technically hard 
parts of the proofs of the specific results are already done in the proofs of the non-uniform 
versions, and all we need to do is to check that they uniformize in our sense. The original 
non-uniform versions are now corollaries of the uniform statements. 



Notation and terminology. A multi-valued function (or multi-function) F from a set X 
to a set Y is formally a subset of X x Y. For x E X , we write F[x] for the set of y E Y 
such that {x, y) belongs to this subset. These y are the "allowable outputs" on input x. We 
denote by domF the set of x G X for which F[x\ is nonempty. When F[x\ is a singleton, 
its unique element is denoted by F{x)^ as usual. If F[x\ is a singleton for all x G domF, 
we say that F is a partial function. When in addition domF = X, we say that F is a total 
function, or simply a function. 

Like some authors [g], 22], we regard computational tasks (problems) as multi-functions. 
The classes FP and FPSPACE consist of multi-functions from strings to strings computed 
by a machine whose time/space is polynomially bounded. Here, computing a multi-function 
is to be interpreted according to the "allowable outputs" semantics mentioned above: A 
machine is said to compute F if, on any input x G domF, it outputs some element of F[x]. 
The classes FP and FPSPACE that we will define later will also consist of multi-functions. 

Note that we do not care what happens on inputs outside domF, unlike some authors 
who require that such inputs be rejected explicitly. Thus a multi-function can be easy to 



COMPLEXITY THEORY FOR OPERATORS IN ANALYSIS 



3 



compute while having a nasty domain. We also note, however, that allowing domF to be 
smaller than X is not so important in the context of time- or space-bounded computation, 
because a machine that runs past the bound for some inputs can be modified so that it keeps 
track of the time and outputs an error message when it has run out of time or space. 

Throughout the paper, E* denotes the set of finite strings over the alphabet E. We will 
tacitly assume, depending on contexts, that E = {0, 1} or that E contains all symbols 
appearing in the discussion. 

Since our applications mainly involve real numbers, it will be convenient to fix a dense 
subset of R and its encoding. For each G N, let D„ denote the set of strings of the form 

(1) sx/lQO_^, 

n 

where s e {+, — } and x G {0,1}*. Let D = |J^gp^D„. A string in D encodes a number 
in the obvious sense — namely, read ([T]) as a fraction whose numerator and denominator are 
integers written in binary with leading zeros allowed. We write |m] for the number encoded 
by M G D. The numbers that can be encoded in this way are called dyadic numbers. 



2. Type-Two Theory of Effectivity 



There are several equivalent formulations for Computable Analysis. One powerful frame- 
work is Weihrauch's Type-Two Theory of Effectivity (TTE) 0, 2^- In this section, we briefly 
introduce the infinite sequence model of TTE and discuss some difficulties in dealing with 
complexity, which motivate our modification in Section [31 



2.1. Computability. In the usual computability theory, we use some machine model that 
computes functions from E* to E*. To discuss computation on other sets X, we specify an 
encoding of X — that is, a rule for interpreting an element of E* as an element of X. 

But we want to deal with uncountable sets, such as the set M of real numbers. Since the 
countable set E* cannot encode them, TTE uses the set E^ of infinite sequences instead. 

Computability of partial functions from E^ to E^ is defined using Turing machines. The 
machine has an input tape, an output tape, and a work tape, each of which is infinite to 
the right. We also assume that the output tape is one-way; that is, the only instruction for 
the output tape is "write a & E in the current cell and move the head to the right". The 
difference from the usual setting is in the convention by which the machine reads the input 
and delivers the output. The input is now an infinite string aocti . . . G E^, and is written on 
the input tape before the computation starts (with the tape head at the leftmost cell). We 
say the machine outputs an infinite string 6o^i • • • G E^ if it never halts and writes the string 
indefinitely on the output tape (that is, for each n G N, it eventually writes 6o • • • ^n-i into 
the first n cells). This defines a class of (possibly partial) computable functions (without any 
time or space bound) from E^ to E^. The definition can be extended to multi-functions A: 
we say that a machine M computes A if M, on any input G domA, always outputs some 
element of A[(f]. 

A representation 7 of a set X is formally a partial function from E^ to X which is 
surjective — that is, for each x E X, there is at least one (p G E^ with 'y{ip) = x. We say 
that ip is a •y-name of x. Computability of multi-functions on represented sets is defined as 
follows. 

Definition 2.1. Let 7 and S be representations of sets X and Y, respectively. We say that 
a machine (7, 6)-computes a multi-function A from X to F if it computes the multi-function 
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Figure 1. (7, (5)-computing a multi-function A. 



6 ^ o y4 o 7 given by 



(2) 



(5-^ oAo 



7)M = I 



{ip E domS : S^ip) G 74[7(y9)] } ii ip E dom7, 
otherwise. 



In other words, whenever the machine is given a 7-name of an element x G domA, it must 
output some 5-name of some element of A[x] (Figured]). 

As an example, we define a representation pR of the set M of real numbers by saying that 
an infinite string (f G is a pR-name of a; G M if is of the form 'Uo7^'Ui#'U2# . . . (where ^ 
is a delimiter symbol not appearing in the Ui) such that G D and | [wj] — x\ < 2~* for each 
i G N. Thus a real number is specified by a list of rational numbers converging to it. It turns 
out that pr is a natural representation with which to discuss computability of real functions. 
In particular, pr is admissible with respect to the usual topology of M [24, Lemma 4.1.6]. 

To deal with functions of two arguments, we define, for representations 7 and S of sets X 
and Y, a representation [7, 5] of X x y by [7, 5](ao&oC^i^i • • •) = {i{clo(^i ■ ■ (^(^o^i • • •))• 

Example 2.2. Addition +: M x M— j-M is ([pr, pr], pR)-computable. For suppose that we are 
given names ip = Mo#Mi# . . . and = Vq^Vi^ ... of real numbers s and t. An approximation 
oi s + t with precision 2""^, for each m, is given by iMm+i] + ["Wm+i]- 

Example 2.3. Multiplication x : M x M — )■ M is ([pr, pr], pR)-computable. Given names ip = 
Uoi^Uii^ . . . and ip = "^o^'^i^ • • • of I'eal numbers s and t, let k = max{|Mo|, |fo|}- Since 
|mo] and |fo] are near s and t, and it takes more than k digits to encode a number with 
absolute value > 2^, we have |s|, |t| < 2'^. Hence, s x t is approximated with precision 2~"^ 
by [ 

A good thing about the TTE formulation is that, by using suitable representations, we 
can discuss computation on many other sets. There are often standard ways to obtain 
representations of higher-type objects such as sets and functions. For example, since we 
have agreed on the representations pr of M, we can introduce a canonical representation of 
the set C[R] of continuous real functions, and there are reasons to believe that this is the 
"right" representation [2I, Chapter 3]. 

2.2. Complexity. Now we start putting time bounds. This means requiring that the nth 
prefix of the output be delivered within time bounded polynomially in n (and independently 

of <p): 

Definition 2.4. A machine M runs in polynomial time if there is a polynomial p such that 
for all (f G and n G N, the machine M on input ip finishes writing the first n symbols of 
the output within p{n) steps. Define polynomial space analogously by counting the number 
of visited cells on all (input, work and output) tapes. 



Can we use this notion to define polynomial-time computability of, say, a real function? 
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2.2.1. Representations must be chosen carefully. A little thought shows that the simple com- 
bination of Definition 12.41 and the representation is useless |2J, Examples 7.2.1, 7.2.3]. On 
the one hand, the machine M could "cheat" by writing redundant pK-names: By writing 
+10000/100000 instead of +1/10 it gets more time to compute the next approximation. On 
the other hand, the machine may suffer by receiving redundant names as input, such as the 
one in which the first approximation is too long to even read in time. 



This motivates the use of signed digit representation psd of R 2J, Definition 7.2.4] defined 
as follows, forbidding redundancy carefully: dompsd consists of sequences ip G of form 
Ofc . . . Oiao • a^ia_2 ■ ■ ■ for some k, where each Oj is either 0, 1 or —1, such that A; = or 
(afc,afc_i) G {(1,0), (1, 1), (-1,0), (-1, -1)}; if this is the case, set Psd{'^) = Yli=-oo(^i ' 2*- 
Thus we read the digit sequence as a binary expansion of a real number (with decimal point 
•) with digits 0, 1 and —1; we forbid certain patterns in the first two digits of the integer 
part in order to exclude redundancy. (See [23, Example 2.1.4.7] for the reason why the usual 
binary expansion without the "—1" symbol does not work.) 

Let Psd|'°'^^ denote the restriction of psd to (infinite sequences representing) real numbers 
in [0,1]. By Definition 12. 4^ we know what it means for a real function /: [0, 1] — t- M 
to be polynomial-time {psd\^'^'^\ psd) -computable. This notion turns out to be robust and 
equivalent to the widely accepted polynomial-time computability of Ko and Friedman fl2|, 
so we will drop the prefix "(psd|'*^'^', Psd)" from now on. The same goes for polynomial- space 
computability, and for functions on compact intervals or rectangles instead of [0, 1] (use 
the pairing function as in Examples 12.21 and 12. 3p . It is routine to verify that, for example, 
addition and multiplication +, x : [0, 1] x [0, 1] — )■ M are polynomial-time computable. For 
more interesting results, see Ko's book [13], survey [l6i] or Weihrauch's book [2^, Section 7.3]. 

2.2.2. Difficulties in generalizing to other spaces. Unfortunately, this approach does not ex- 
tend much further. For example, a naive extension to real functions on M (instead of [0, 1]) 
does not work: polynomial-time (psd, Psd)-computability tends to fail for trivial reasons. 

Example 2.5. Addition on M (Example l2.2p is not polynomial-time ([psd, Psd], Psd) -computable. 
For suppose that a machine ([psd, Psd], Psd)-computed it within a polynomial time bound p. 
In particular, the machine has to write the first symbol of the output in t := p(l) steps or 
fewer. Note that this first symbol must be 1 if the sum is greater than 1, and —1 if the sum 
is less than —1. In particular, it must be 1 if the two summands are 2*"'"^'"^ and —2*+^*^, and 
— 1 if they are 2*+^" and —2*+^"°. However, the machine cannot tell between these two cases, 
because it can read at most t symbols of the input in time. 

The trouble seems to be that the time bound is independent of the input. Compare 
this with the addition of integers (written in binary) by the usual Turing machine. It is in 
polynomial time, because a large summand would make the "input size" big and thereby 
give the machine more time. For the same thing to happen for addition of the real numbers, 
we would need to talk about the "size" of the input and a time bound "polynomial in" it, 
but we do not have the notion of size for infinite sequences. We could simply require, as 
Hoover [3] and Takeuti [2l[ did (see Section l^?T]) . that the time to output the ith bit below 
the decimal point may depend polynomially in both i and the logarithm of the absolute value 
of the input real number. This would have the same effect as our proposed extension of the 
computation model, in this specific case of R — but our point is that we want a coherent 
theory of computation that is applicable to other spaces by just switching representations. 
There are many objects other than M that we want to give representations to. The objects for 
which the infinite string model gives reasonable notions of complexity are limited, compared 
to what we can do at the level of computability (see the discussions in Ko [l^, pp. 57-58], 



Weihrauch [25(], and Brattka et al. [3!, p. 484]). Because of this limitation, the complexity 
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Figure 2. Computing a set S means that, given (u, 0"), one can tell whether the distance 
of the point ([uj, Jv]) from S is less than 2~" or more than 2 • 2~". 



of operators has been mostly formulated in non-uniform ways. We quote examples of such 
theorems below. We will reformulate them uniformly later (Theorems 14.61 and 14. 101) . 

2.2.3. Non-uniform results. The first pair of results are the positive and negative statements 
about the operator of taking the convex hull CH{S) of a closed set S C [0, 1]^. 

Polynomial-time computability of a set S* C [0, 1]^ is defined as follows (see e.g. Braver- 
man [5] for a discussion), using the usual complexity class P. We say that S is polynomial-time 
computable if there is a function (f: E* {0, 1} in P such that, for any n G N and m, f G D, 

• ip{u, V, 0") = 1 if distiduj, IvJ), S) < 2~", and 

• <^{u, V, 0") = if distllluj, Ivj), S)>2- 2"", 

where dist{p,S) := inf^g^Hp — g|| denotes the Euclidean distance of point p G from S 
(Figure [2]). Likewise, S is said to be nondeterministic polynomial-time computable if there 
is such a in NP (recall the asymmetry between the outcomes 1 and in the definition of 
NP: we require an easily verifiable certificate for (|m], |f]) being close to S). 

Ko and Yu |17|] and Zhao and Miiller 26j essentially proveqj the following non-uniform 



theorems about the complexity of taking the convex hull of a set. 

Theorem 2.6. If a closed set S C [0, 1]^ is polynomial-time computable, then its convex hull 
CH{S) is nondeterministic polynomial-time computable. 

Theorem 2.7. Unless P = NP, there exists a closed set S C [0, 1]^ which is polynomial-time 
computable, but whose convex hull CH{S) is not. 

For A C M°', let C[A] be the set of continuous functions from A to M. The second pair of 
results concerns the initial value problem (IVP) of the differential equation 

(3) h{0) = 0, h'{t)=g{t,h{t)), 

where g G C[[0, 1] x M] is given and h G C[0, 1] is the unknown. It is well known (see [l^, 
beginning of Section 3]) that the solution h exists and is unique if g is Lipschitz continuous 
(in the second argument), that is, 

(4) \g{t,yo) - g{t,yi)\ < L-\yo~yi\ 



^Ko and Yu state both the positive and the negative results (Theorems 12.61 and 12. 7p for polynomial-time 



strong recognizability instead of our computability 17|, Corollaries 4.3 and 4.6, respectively], but their proof 



almost works for computability as well. For a discussion comparing the two notions, see Braverman 
where Ko's strong recognizability is called weak computability. Zhao and Miiller use the polynomial-time 
computability equivalent to ours and prove Theorem 12.61 [26l Theorem 4.3]. For the positive part, in fact 
they prove a uniform result essentially equivalent to the positive part of our Theorem 14.61 [26 . Theorem 4.1]. 
Although they state the upper bound of "exponential time", their proof contains the argument that is 
necessary to derive the non- uniform NP upper bound (our Theorem 12. 7p [26|, Lemma 4.2]. 
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for some constant L independent of t, i/o, yi. The following results state how complex h can 
be, assuming that g is polynomial-time computable. Since polynomial-time computability is 
defined only for functions with compact domain, we restrict g to the rectangle [0, 1] x [—1, 1]. 
If there is a solution h G C[0, 1] whose values stay in [—1, 1] (in which case h is unique, as 
mentioned above), we write LipIVP{g) for this h. Thus LipIVP is a partial function from 
CL[[0, 1] X [—1, 1]] to C[0, 1], where the former set is the subset of C[[0, 1] x [—1, 1]] consisting 
of Lipschitz continuous functions. 

Theorem 2.8 ([isl. Section 40). If g ^ dom LipIVP is polynomial-time computable, then 
LipIVP{g) is polynomial- space computable. 

Theorem 2.9 ([lo|. Theorem 3.2]). There is a polynomial-time computable function a £ 
dom LipIVP such that LipIVP{g) is polynomial- space complete (in the sense defined in 

or 0y;. 

We can derive from Theorem 12.91 a statement of the form similar to Theorem 12.71 

Corollary 2.10 ( fiol . Corollary 3.3]). Unless P = PSPACE, there is a real function g G 
dom. LipIVP which is polynomial-time computable but LipIVP{g) is not. 

3. Using functions as names 
We present the main definitions for our framework here. 

As we have noticed, the limitations of the approach with the infinite sequences in have 
to do with the fact that they do not carry enough information, and in particular their size is 
not defined. We replace with Reg, a class of string functions which we will use as names 
of real numbers, sets and function^. 

In Section 13. we introduce the class Reg of regular functions and define what it means 
for a machine to compute a multi-function from Reg to Reg. Section 13.21 defines what 
it means for such a machine to run in polynomial time or space, thus introducing several 
complexity classes of multi-functions on Reg. In Section 13. 3[ we define reductions between 
such multi-functions, and discuss the resulting notions of hardness. Section 13.41 extends this 
theory of computation on Reg to that on other sets X by using representations of X by 
Reg. 

3.1. Computation on regular functions. We say that a (total) function ip: E* E* is 
regulai^ if it preserves relative lengths of strings in the sense that |v5(m)| < |v^(f )| whenever 
\u\ < \v\. We write Reg for the set of all regular functions. For the rest of this paper, we 
will be discussing the complexity of multi-functions from Reg to Reg. The motivation for 
considering regular functions (rather than all functions from E* to E*) will be explained in 
Section 13.21 where we define their lengths. 

Now we begin replacing the role of E^ (Section 12. ip by Reg. This is a generalization, 
because an infinite string aoOi . . . G E^ can be identified with a regular function ip G Reg 
that 

(a) takes values of length 1, and 

(b) depends only on the length of the argument, 

■^Ko [13i| proved Theorems 12.81 and 12.91 with a condition shghtly weaker than Lipschitz continuity. On the 
other hand, Ota et al. [20:] show that Theorem 12.91 can be strengthened to yield a continuously difFerentiable 
function g. 

'^Ko's formulation [13] already uses string functions instead of infinite strings, but it does not take full 
advantage of this extension, because queries to these functions are mostly restricted to unary strings 0". 

^(Note added in May 2013) After the publication of this article in a journal, some authors started using 
"length-monotone" , which is perhaps a more informative and better terminology. 
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(for some -0 G ^[</']) 

Figure 3. A deterministic machine computing a multi- function A from Reg to Reg. 

by setting ip{0"') = a„. In the following, observe that Definitions I3.1IIT] and 13.21 extend their 
counterparts in this sense. 



It sometimes makes sense to stop the generalization halfway, removing (b) only and keeping 



a) Let Pred C Reg be the set of {0, l}-valued regular functions. 

Instead of the machine that worked on infinite strings, we use an oracle Turing machine 
(henceforth just "machine") to convert regular functions to regular functions (Figure [3]): 

Definition 3.1. (1) A deterministic machine M computes a multi-function A from Reg 
to Reg if for any (f G domA, there is ip & ^[f] such that M on oracle (f and any 
string u outputs ipi^u). 

(2) A nondeterministic machine M computes a multi-function A from Reg to Pred if 
for any if G domA, there is ip ^ ^[f] such that ipi"^) = 1 if and only if M on oracle ip 
and string u has at least one accepting computation path. 
For the precise conventions for issuing and answering queries, follow any of jo], [13, 19 • 



3.2. Polynomial time and space. Recall that regular functions are those that respect 
lengths in the sense explained at the beginning of Section 13.11 In particular, they map 
strings of equal length to strings of equal length. Therefore it makes sense to define the size 
\ip\: N — )■ N of a regular function v? by Iv^KImI) = |v5('u)|. It is a non- decreasing function from 
N to N. 

Now we want to define what it means for a machine to run in polynomial time. Since 
is a function, we begin by defining polynomials "in" a function, following the idea of Kapron 
and Cook |9|. Second-order polynomials (in type-1 variable L and type-0 variable n) are 
defined inductively as follows: a positive integer is a second-order polynomial; the variable n 
is also a second-order polynomial; if P and Q are second-order polynomials, then so are 
P + Q, P ■ Q and L(P). An example is 

(5) L(L(n-n ))+L(L(n)-L(n))+L(n)+4. 

A second-order polynomial P specifies a function, which we also denote by P, that takes a 
function L : N — )■ N to another function P{L) : N — ?■ N in the obvious way. For example, if 
P is the above second-order polynomial and L{x) = x^, then P{L) is given by 

(6) P{L){x) = {{x ■ xfY + (x^ ■ x^ + + 4 = 2 ■ X® + + 4. 
As in this example, P{L) is a (usual first-order) polynomial if L is. 

Definition 3.2. A (deterministic or nondeterministic) machine M runs in {second- order) 
polynomial time if there is a second-order polynomial P such that, given any ip G Reg 
as oracle and any m G 17* as input, M halts within P(|v9|)(|m|) steps (regardless of the 
nondeterministic choices). Define polynomial space analogously by counting the number of 
visited cells on all (input, work, output and query) tapes. 



This extends Definition 12. 4[ because when ip satisfies (a) (of Section [3.11) . the size \(p\ is 



constant, and the bound P(|(y9| )(!«!) reduces to a (first-order) polynomial in |m| 
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Definition 3.3. (1) We write FP (resp. FPSPACE) for the class of multi-functions from 
Reg to Reg computed by a deterministic machine that runs in second-order poly- 
nomial time (resp. space). 
(2) We write P (resp. NP) for the class of multi-functions from Reg to Pred computed 
by a deterministic (resp. nondeterministic) machine M that runs in polynomial time. 

Note that unlike the type-one counterparts, it is easy to separate FPSPACE from FP and 
NP from P, because the former classes contain functions that depend on exponentially many 
values of the given oracle. 

It is also easy to see that these classes respect the corresponding type-one classes: 

Lemma 3.4. (1) Functions in FP (resp. FPSPACEj map regular functions in FP into 
FP (resp. FPSPACE into FPSPACE;. 
(2) Functions in P (resp. HP) map regular functions in FP into P (resp. HP). 

Why we use only regular functions. The idea of using second-order polynomials as a bound 
on time and space comes from Kapron and Cook's characterization jol of Mehlhorn's class (Toj 
of polynomial-time computable operator^. This is a class of (total) functionals F : [E* — > 
r*) X r* ^ r*, but they can be regarded as F : {E* ^ E*) {E* E*) by writing 
F{ip){x) for F{(p,x). Kapron and Cook define the size of (f: E* E* by 

(7) Iv^K"-) = niax|(y9(M)|, n eN. 

\u\ <n 

Note that our definition of size for regular (p is a special case of this. They then defined 
the class of polynomial-time functionals in the same way as Definition 13.31111 (We added 
FPSPACE by analogy.) 

We have restricted attention to regular functions. This is because, in order to obtain 
reasonable complexity notions, it seems necessary for a machine to be able to tell when the 
time bound is reached. Note that for usual (type-one) computation, it was easy to find \x\ 
given X, and thus to clock the machine with the time bound p(|x|) for a fixed polynomial p. In 
contrast, finding the value ([7]) for a given ip in general requires exponentially many queries to 
ip. For regular ip, we can easily find Iv^K^) for each n, and thus the second-order polynomial 
P(|(y9|)(|u|) is a bound "time-constructible" from p and u. 

Imposing regularity is hardly a restriction for our purpose, because our intention is to use 
these functions as names of real numbers, sets and functions, and we can simply require 
that valid names are those that have been "padded" to be regular. More precisely, there 
is an efficient machine that takes as oracles a possibly irregular function p>' and a regular 
function ip dominating its length (i.e., |v''(w)| < iV^KIul) for any string u), and delivers a 
regular function p) such that \p\ = \ip\ and p{u) = p'{u)^^ • • • #• Thus we use p, instead 
of p', as the name. In many situations we can find such a dominating function ip. 

For later use we define the pairing function for regular functions as follows (we have been 
and will be using the tupling functions for strings, which we do not write explicitly): for 
p, ip e Reg, define {p,ip) G Reg by setting {p,ip){Ou) = p{u)10^^^'^'^^ and {p^ip){lu) = 
'?/'(«) lO''''^"^! (we pad the strings to make {p,ip) regular). Let {p,ijj,9) = {{p,ip),9), etc. 

3.3. Reduction and completeness. Here we define reductions between multi-functions on 
Reg and discuss hardness with respect to these reductions. 



'Kapron and Cook '9\ call them Basic Feasible Functionals or Basic Polynomial- Time Functionals. 
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some V € A[u\ 




some V € A[u\ 




G AH 



Figure 4. Reductions between multi- functions A, B on E* . 



3.3.1. Reductions. Recall that the usual many-one reduction between multi-functions A, B 
from S* to E* is defined as follows: we say that A many-one reduces to B (written A <]^-p B) 
if there are (total) functions r, t G FP such that for any u G domA, we have r{u,v) G A[u\ 
whenever v G B\t{u)\ — that is, we have a function t that converts an input for A to an input 
for B, and another function r that converts an output of B to an output of A (Figure HI 
left). The many-one reduction between predicates is defined as the special case where 
we do not convert the output, i.e., r(u, v) = v (Figure IH middle). Since multi-functions over 
Reg also get a function as input, the analogous definition of reductions involves one more 
converter s: 

Definition 3.5. (1) Let A and B be multi-functions from Reg to Reg. We say that A 
many-one reduces to B (written A <^p B) if there are functions r, s, t G FP such 
that for any if G domA, we have s{ip) G domi? and, for any 9 G B[s{ip)\, the function 
that maps each string x to r{({)){x,6{t{ip){x))) is in A[({)\ (Figure [5|, top left). 
(2) Let A and B be multi-functions from Reg to Pred. We write A <^ B if there are 
functions s, t ^ FP such that for any cp G domA, we have s{ip) G domB and, for any 
9 G B[s{ip)], the function 9 o t{{p) is in A[ip] (Figure 0, top right). 

The design of these reductions is somewhat arbitrary. We chose them simply because they 
are strong enough for our hardness results (Theorems 14.61 and 14. lOp . What Beame et al. [2] 
call the "many-one reduction" between type-two functions is slightly stronger than ours in 
that it passes the string input u not only to t and r but also to s (Figure [5], bottom left). 
See the comment after Lemma 13.61 for the reason we did not choose this definition. 

Another reasonable notion of reduction is the one on the bottom right of Figure [5j 

Definition 3.5 (continued). (3) Let A and B be multi-functions from Reg to Reg (or 

to Pred). We say that A Weihrauch reduces to B (written A <^ B) if there are 
functions r, s G FP such that for any ip G domA, we have r{{ip,ip)) G A[(p\ whenever 

e B[s{^)]. 



This is a polynomial-time version of the continuous reduction used by Weihrauch 23] to 
compare the degrees of discontinuity of translators between real number representations (see 
also Brattka and Gherardi [3]). Note that, while this reduction is somewhat analogous to the 
type-one Turing reduction (Figure IH right), it also formally resembles the definition of <mF- 
The many-one reduction <^p is the special case of this reduction <^ where r can query ip 
only once. Beame et al. [2] define an even stronger "Turing reduction". 

In this paper, we will formulate our hardness results mainly using <^p and <^ because 
they give stronger results than <^ would. The advantage and disadvantage of this choice 
will be discussed in Section 14.31 after Theorem 14.101 and Corollary 14.111 
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tp{x) 

(for some ip £ ^ 




(for some ■0 £ ^[v']) 



A<lB 




tp{x) 

(for some t/j £ ^[v]) 

A many-one reduces to B 
in the sense of M 




(for some ip G j4[(/p]) 



Figure 5. Reductions between multi- functions on Reg. 



3.3.2. Hardness. Now that we have the classes (Definition 13. 3p and reductions (Definition 
13. 5p . we can talk about hardness. A multi-function B from Reg to Reg is FPSPACE-<^p- 
hard if A <^p B for every A e FPSPACE. It is said to be FPSPACE-<l^p-complete if 
moreover it is in FPSPACE. We define NP-<^-hardness of multi-functions from Reg to 
Pred similarly (note that NP is not closed under <mF)- 

The following lemma states roughly that a C-<^-hard multi-function B maps some function 
ip G FPnReg to a C-<^-hard function, where C and <^ are the type-one versions of the class 
C and the reduction <^. But since B[ip] may consist of more than one function, we need to 
assert hardness for the multi-function IJl-^i"^]) defined as follows: for a nonempty set F of 
(single-valued total) functions from X to Y, we write IJ F to mean the multi-function from 
X to y defined by (IJ-^)W — { /(^) '■ f ^ Saying that the multi-function |JF is hard 
is a stronger claim than saying that each of the functions in F is hard, because the former 
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requires that one reduction work for all functions in F. We need to state the following lemma 
in this stronger form in order to derive Lemma 13.121 later. 

Lemma 3.6. (1) Let B he an FPSPACE-<^p-com2)/ete multi-function from Reg to Reg. 
Then there is E domB fl FP such that \J{B[%1)\) is FPSPACE-<Jj^p-comj»/ete. 
(2) Let B he an HP -<'^- complete multi-function from Reg to Pred. Then there is E 
domB n FP such that \J{B[iIj]) is NP-<l^-complete. 

Proof. We only prove the first claim (the second claim is similar). There is a function 
A G FPSPACE that maps some function 99 G FP fl Reg to an FPSPACE-<j!^p-complete 
function. Since A <^p B, there are functions r, s,t E FP as in Definition |331 By Lemma 137^1 
we have r{ip), s{ip), t{ip) G FP. Let = ■^(v^). Since r{ip) and t{ip) give a reduction 



My^) <mF [JiB[ij]), and A{^) is FPSPACE-<J„F-complete, U(^M) is also FPSPACE-< 



We note that Lemma 13.61 would not have been true, if in the definition of reductions we 



had fed s with the string input as Beame et al. [2] do (see the comment after Definition I3.5p . 
For let <l be the reduction which is like <^ but feeds s with the string input, and let B be 
a C-<^-complete multi-function. Then the multi-function B' defined by 



where const^ G Reg denotes the constant function with value u, is C-<^-complete by the 
modified reduction where "s does the job that t used to do". Yet each one of the values of 
B' is a constant function. 

3.3.3. Some complete prohlems. Let PSPACE be the subclass of FPSPACE consisting of 
multi-functions from Reg to Pred. Here we list some NP- and PSPACE-<^-complete prob- 
lems. Their completeness can be proved by relativizing the well-known NP- and PSPACE- 
<^-completeness in a straightforward way. 

We begin with NP-<^-complete problems. For a non- decreasing function /i: N^-N, define 
fl G Reg by ]l{u) = C*^'"'-*. A Boolean formula involving predicate symhol p is an expression 
built up inductively from Boolean variables oi, 02, ... using the connectives /i A /2, /i V /2, 
-1/1 and p(/i, . . . , fn) (the arity n can vary) for any previously obtained formulas /i, /2, .... 

Lemma 3.7. The following partial functions ntime^, exist^ and sat^ from Reg to Pred 
are NP -<^- complete: 

• domNTIME^ consists of all triples {M,JI,ip) such that M is a (program of a) nonde- 
terministic (oracle Turing) machine, fi: N— J-N zs non- decreasing, ip G Reg, and for 
any string u, all computation paths of M'^i^u) halt in time ix{\u\) (this M is a string, 
so we encode it as the constant function taking this string as value). For any such 
triple and a string u, we have NTIME^((M, /I, (y9))('u) = 1 if and only if M'^{u) has an 
accepting path. 

• domEXlST^ = Pred. For any p G Pred, u E E* and n eN, we have exist^(p)(m, 
0") = 1 if and only if there is a string v of length n with p{u, v) = 1. 

• domSAT^ = Pred. For any p G Pred and any string u, we have sat^(p)(m) = 1 
if and only if u is a Boolean formula involving a predicate symhol p and it is made 
satisfiahle when p is interpreted as p. 

If is a Boolean formula involving predicate symbol p, then an expression of the form 

(10) Qifli. Q2a2. Qsas . . . Qk^k- </'(ai, • • • , Ofc), 



complete. 



□ 



(8) 
(9) 



domS' = { (constt(,v5) : u G ip G domi?}, 
5'[(const„,v?)] = {const^(^,) : ip G B[ip\ }, 
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where each Qi is either V or 3, is called a quantified Boolean formula involving predicate 
symbol p. Its truth value is determined in the obvious way relative to the predicate to be 
substituted into p. 

Lemma 3.8. The following partial functions SPACE^, POWER^, QBF^ from Reg to Pred are 
PSPACE-<l^-complete: 

• domSPACE^ consists of all triples {M,JI,ip) such that M is a (program of a) deter- 
ministic (oracle Turing) machine, fi: N— j-N is non- decreasing, ip G Reg, and for any 
string u, the computation M'^iu) uses no more than ix{\u\) tape cells and either ac- 
cepts or rejects (this M is a string, so we encode it as the constant function taking this 
string as value). For any such triple and a string u, we have SPACE^((M, /I, <f)){u) = 1 
if and only if M'^iu) accepts. 

• domPOWER^ consists of all f G Reg that are length-preserving (i.e., \f \ = id). For 
any such f and a string u, we have power^(/)(u) = I if and only if f'^^''\u) = O'"', 
where we write f^ for f iterated k times. 

• domQBF^ = Pred. For any p G Pred and any string u, we have QBF^(p)(u) = 1 if 
and only if u is a quantified Boolean formula involving a predicate symbol and it is 
made true by p. 

3.4. Representations. As we replaced by Reg, we extend the notion of representations 
accordingly: a representation 7 of a set X is a surjective partial function from Reg to X. 
Computation relative to representations is again formulated by Definition 12.11 This defines 
what it means for a multi-function F from X to Y, where X and Y are sets equipped with 
representations 7 and 6, respectively, to be in (7, 6)-C, where C is one of the classes we have 
defined, such as FP and FPSPACE. This C can be P or NP if dom6 C Pred. Also, we say 
that F is {-i,5)-C-<-hard/ complete (for C = FPSPACE, NP) if d'^oFo-^ (see Definition [2?T|) 
is C-<-hard/complete. 

3.4.1. Translation and equivalence. Here we discuss how the class (7, 5)-C and (7, 5)-C-<- 
hardness depend on the choice of representations 7 and 5. For two representations 5 and 5' 
of the same set, we write 5 < 5' ii there is a function F G FP that translates 5 to 5' in the 
sense that for all 99 G dom5, we have F{ip) G dom.5' and 5{ip) = 6'{F{lp)). Thus 6 is "more 
informative" or "less generic" than 6'. It is easy to see the following. 

Lemma 3.9. Let C be either FP or FPSPACE. Let 7 and 7' be representations of a set A, 
and 6 and 6' be representations of a set B. If '~f' < '~f and 6 < 6' , then (7, 6)-C C (7', 6')-C. 

We write 7 = 7' if 7 < 7' and 7' < 7. Lemma 13.91 implies that the class (7, 6)-FP is 
invariant under replacing 7 or 5 with =-equivalent representations. 

By reversing the directions of the translations between 7, 7' and 5, 5' in the assumption, 
we get the implication between hardness results under different representations: 

Lemma 3.10. Let 7 and 7' be representations of a set A, and 6 and 6' be representations 
of a set B. If j < 7' and 6' < 6, then a (7, 5)-FPSPACE-<^-/iarc? multi-function is {'-f',6')- 
FPSPf^CE-<lf-hard. 

Here, <^ is the stronger reduction in Definition 13.51131 (note that would not work). 

3.4.2. Uniform and non-uniform statements. We say that an element x G X is in 7-C (where 
C is a usual complexity class of string functions, such as FP and FPSPACE) if it has a 7-name 
in C. It is J -C-<- complete (where < is either <^p, <m or <^) if IJ(7~"'^N) (where -"^ is the 
inverse image, and |J is defined before Lemma 13. 6p is C-<-complete. Lemmas 13.41 and 13.61 
yield the following. 
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Lemma 3.11. Let 7 and 6 be representations of sets X and Y , respectively. 

(1) A partial function F G (7,5)-FP maps elements 0/7-FPndomF into (5-FP. Similarly 
for FPSPACE and FPSPACE replacing FP and FP. 

(2) Suppose that dom5 C Pred. Then a partial function F G (7, 5)-P maps elements of 
7-FP n domF into 5-P . Similarly for NP and NP replacing P and P. 

Lemma 3.12. Let 7 and 5 he representations of sets X and Y , respectively. 

(1) A (7, (5)-FPSPACE-<^p-com|?fefe partial function F maps some element 0/ 7-FP fl 
domF to a 5-FPSPACE-<Jj^p-comj9/efe element ofY. 

(2) Suppose that dom5 C Pred. Then a (7, 5) -HP -<^- complete partial function F maps 
some element 0/7-FP fl domF to a 5 -\-\P-<]^- complete element ofY. 

These lemmas will be used in Sections 14.21 and 14.31 to derive the non-uniform theorems 
from their uniform counterparts. 



4. Applications 



As noted in Section |3TT| our formulation can be viewed as a generalization of TTE achieved 
by removing the restrictions (a) and (b) on the oracle used as names. In the following three 
subsections, we will apply our theory to real numbers, real sets and real functions through 
representations p^, ip@, and 5n, which exploit the removal of (a) , (b) , and both, respectively. 

For representations 70 and 71 of Xq and Xi, respectively, we can define the representation 
[70,71] of the Cartesian product Xq x Xi by [70, 7i]((</9o, v^i)) = (toIv^o), Tilv^i))- 



4.1. Computation on real numbers. Recall the representation of M by infinite se- 
quences (Section 12. ip where a pM-name of a real number x was a list mo#mi# ... of rational 
numbers \ui\ with —x\< 2~*. We adopt this in a straightforward way to define a repre- 
sentation pr that encodes real numbers by regular functions (we keep writing p^ by abuse of 
notation): we say that ip G Reg is a pR-name of x G M if v^(0*) G D and ||v5(0*)] — x\ < 2^* 
for each i G N. Thus we encode the same list in the values v^(0*). 

We write PrI'^'^^ for the restriction of pk to (names of) real numbers in the interval [0, 1]. It 
is easy to see that the class (pr|'°'^', Pr)-FP coincides with the polynomial-time computability 
that was defined in Section 12 . 2 . II using the signed digit representation p^d- Recall that in the 
definition of psd, we needed to forbid redundancy carefully. Now we do not have to worry 
too much about defining concise representations. 

Moreover, we obtain a reasonable notion of polynomial-time computability of real func- 
tions / on M (not just [0, 1]) without additional work: (pR, pr)-FP turns out to be a reasonable 
class that coincides with the one by Hoover who required that the 2~™-approximation of 
the value f{t) should be delivered within time polynomial in m and log|t| (this equivalence 
has been essentially observed by Lambov [l8[). Another equivalent definition appears in 
Takeuti j2l[, inspired by Pour-El's approach to computable analysis. 

Example 4.1. It is easy to see that binary addition and multiplication on M are in ([pr,Pr], 
Pr)-FP by the algorithms suggested by Examples 12.21 and 12.31 

Example 4.2. The exponential function exp: M— )-]R restricted to [0, 1] is in (prI^^'^^, Pr)-FP, 
because exp t can be written as the sum of a series which is known to converge fast on [0, 1] 
(that is, given a desired precision, the machine can tell how many initial terms it needs to 
compute). However, exp on the whole real line M is not in (pr,pr)-FP, because it grows too 
fast. 
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Figure 6. The trisector curves between two points. 

Example 4.3. The sine function sin: M— )-M is in (pk,pk)-FP. To see this, note that just hke 
exp in the previous example, sin is polynomial-time computable if restricted to, say, [—4,4]. 
It is also possible, given t G M and a desired precision, to find efficiently a number in [—4, 4] 
which is close enough to t modulo 2tt. We can compute sint by combining these algorithms. 

Example 4.4. A function can belong to {p^, p^)-FP without even an explicit description 
known. The trisector curves (Figure E]) between the points (0,1) and (0,-1) in the plane 
are the pair of sets Ci, C2 C such that Ci is the set of points equidistant from (0, 1) 
and C2, and C2 is the set of points equidistant from (0,-1) and Ci. Asano, Matousek 
and Tokuyama [H proved that such a pair (Ci,C2) exists and is unique (see and [ll[ 
for simpler and more general proofs). They also showed that Ci (as well as C2, which is its 
mirror image) is a graph of a function / : R — )■ M which is, in our terminology, in (p^, pir)-FP. 
They conjecture that these curves are different from any curve that was previously known. 

4.2. Computation on real sets. 

4.2.1. Representation of real sets. Let A be the set of closed subsets of [0, 1]^. Define the 
representation tp^ of A as follows: let if G Pred be a ^/'©-name of 5* G ^ if it satisfies the 
two itemized conditions in Section 12.2.31 Note that this representation is more succinct than 
the one that we would be able to define using infinite sequences [2^, Example 6.9]. 

Since domip@ C Pred, it makes sense to talk about ■?/'@-NP and (-0®, '?/^@)-NP (Section 
13.4.21) . The following is immediate from the definition of polynomial-time computability in 
Section [2231 

Lemma 4.5. A set in A is (nondeterministic) polynomial-time computable if and only if it 
is in V'q-P (V®-NPj. 

4.2.2. Complexity of the convex hull operator. The operator CH taking convex hulls (Section 
12.2.31) is a function from A to A. We can state and prove the following uniform version of 
Theorems 12.61 and 12.71 As corollaries to this, we get Theorem 12.61 by Lemmas 13 . 1 1 Il2] and 14. 5[ 
and Theorem 12.71 by Lemmas 13.12112] and 14.51 

Theorem 4.6. CH is {tp@, ip(o))-NP-<'^-complete. 

Proof. The main technical ideas are already in Ko and Yu's proof of the non-uniform versions 
(Theorems 12.61 and 12. 7p . so we will only sketch the proof. 

That CH belongs to ('?/'@, '?/'@)-NP is no surprise: A point p belongs to CH{S) if there are 
two points p' and p" in S such that p is on the line segment p'p". All we have to do is to 
guess p' and p" nondeterministically, with appropriate consideration of precision. 
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Figure 7. Widget for reducing NP to CH. We have € CH{S) if and only if there is u 
such that the slot for {w, u) has a bump. In Ko and Yu's construction of S, the bumps can 
be high (left), and there can be a query that requires the knowledge of B(w,u) for many 
u. We make the bumps low (right) in order to make S polynomial-time computable in our 
sense. 



For hardness, we need to modify the proof shghtly, because, as we noted earher, Ko and 
Yu's original results were about a weaker notion of computability: our computability of sets 
demands more in the sense that on query {u,v,0"'), where m, f e D and n G N, if (|m], {vJ) 
is within distance from the set, then we must say 1 (see the definition before Theorems 
12.61 and l2.7p . whereas for weak computability both or 1 are allowed in this case. 

We assume that the reader has Ko and Yu's proof [13, Corollary 4.6] at hand. The proof 
of their Lemma 4.4 begins by taking an arbitrary set A G NP and noting that there are 
B E P and a polynomial p such that w E A if and only if {w, u) E B for some string u of 
length exactly p(|w|). Relativizing this, we take A G NP, and note that there are B E P and 
a second-order polynomial P such that A{(f ){w) = 1 if and only if B{(p){w,u) = 1 for some 
string u of length P(|(y9|)(|w|). 

We need to provide s and t of Definition 13.51 which reduce A to ip@^ o CH o -i/jg. We define 
s by describing the set S = '?/'@(s (</))) for a given (p G Reg. The construction is similar to 
the original proof, replacing p{n) by P{\{p\){n) and B by B{ip). 

The original proof constructs, for each string w, the widget in Figure [7] left (or Figure 2 
of [l3])- III each of the left and right halves, there are exponentially many slots, one for 
each u, that have a bump if and only if {w,u) is in B (or B{(p) for us). The point of this 
construction is that, while the set S is easy to compute, CH{S) is hard in the sense that we 
can tell if tf is in A (or A{(p)) by checking whether the middle point belongs to CH{S). 
But this S is not easy in our sense, because in order to answer the query shown in Figure [3, 
we need to know B{ip){w,u) for exponentially many u. To avoid this, we make the bumps 
low, so they make an angle of at most 45° (Figure [7] right). This ensures that any one query 
to the ipQ-name of S can be answered by checking B{(f){w, u) for at most one (w, m), making 
s computable in polynomial time. 

The function t queries whether the point Y^ is in CH{S) with appropriate precision. Note 
that if: needs access to ip in order to find the location of Y^ and the necessary precision. □ 

4.3. Computation on real functions. 

4.3.1. Representation of real functions. We say that a non- decreasing function fi: N — ?■ N 
is a modulus of continuity of a function / G C[0, 1] if for all n G N and t, t' G [0, 1] such 
that \t - t'\ < 2-'^("), we have \ f{t) - f{t')\ < 2"" (Figure E]). Note that any / G C[0, 1] is 
uniformly continuous and thus has a modulus of continuity. 
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l*t 

Figure 8. Modulus of continuity of a real function / G C[0, 1]. 

Define the representation 6\j of C[0, 1] as follows (see Lemmas 14.71 and 14.91 below for the 
reasons why we believe 6o to be a natural representation): for /i: N — N and (p G Reg, we 
set fc((7i, If)) = / if and only if /i is a modulus of continuity of / and for every ri G N and 
M G D, we have v := ip{0'^,u) G D and — ["yjl < 2~" (the string v may have to have 

leading Os padded in order to make (f regular — but this need for padding is inconsequential, 
see the penultimate paragraph of Section 13. 2( in what follows, we omit this padding in 
the description of algorithms). To see that Sn{ip) is well-defined, suppose that the above 
condition holds for two real functions / and /'. Let t G [0, 1] be arbitrary. Then for each 
n G N, there is m G D with \t - Ml < 2-^(") and thus 

(11) |/(t) - nt)\ < |/(t) - /(M)| + |/(M) - MO-,u)j\ 

+ lf(M)-I^r,«)ll + |/'(t)-/'(M)l 
< 2"" + 2~" + 2^" + 2''' = 2-"+^ 

Since n G N was arbitrary, f(t) = fit). Since t G [0, 1] was arbitrary, / = /'. 

Recall that the only reason that a real number can require long p^-names was having 
a large absolute value. In contrast, functions in C[0, 1] may have long 5n-names for two 
possible reasons: having big values, and having a big modulus of continuity. 

The following lemma says that the complexity of 5n-iiames of / G C[0, 1] matches the 
complexity of / that was discussed in Section WA\ using the representation pr: 

Lemma 4.7 ([3, Corollary 2.21]). A function in C[0, 1] is polynomial-time (resp. polynomial- 
space) computable if and only if it is in Sq-FP (resp. (5n-FPSPACE^. 

Lemma 4.8. A function in C[0, 1] is PSPACE- complete in the sense of fldi . Section 2.2] if 
it is (5n-FPSPACE-<^p-comj)/ete and has a polynomial modulus of continuity. 

Proof. Suppose that / G C[0, 1] is 5n-FPSPACE-<J^p-complete and has a polynomial modulus 
of continuity /i. Then for any A G PSPACE there are polynomial-time functions t and r that 
satisfy the first picture of Figure H] for any B G 5n^[/] — thus for any B of the form (/I, Lp) 
(that is, those with this particular polynomial /i in the first component). A query to B can 
ask either a value of p or a value of but /i is just a polynomial, so we may assume that t 
only asks a query of form 'V(0", f )?". Thus, given m, an answer in A[u\ can be computed by 
r from u and a 2~"'-approximation of /(|f])- This implies that / is PSPACE-complete. □ 

The representation 5u of C[0, 1] may look somewhat arbitrary at first sight. Here we 
present a property of 5u that seems to make it a "natural" representation. Define the 
function Apply: C[0, 1] x [0, 1] — t- M by Apply{f,x) = f{x). The following lemma says that 
(the =-equivalence class of) the representation 6^ is the least informative representation of 
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C[0, 1] that makes Apply efficiently computable (see Section [3.4.11 for the definitions of < 
and =). The proof will appear in a forthcoming paper. 

Lemma 4.9. Let 6 be any representation o/C[0, 1]. Then Apply G ([5, prI'^'^I], pk)-FP if and 
only if 5 < 5u- 

The above definitions and lemmas extend to some well-behaved compact domains other 
than [0,1] (we keep writing 5u by abuse of notation). To discuss the complexity of the 
operator LipIVP (Sect ion [2213]), we define a representation 5ul of the space CL[[0, 1] x [—1, 1]] 
of Lipschitz continuous functions by setting 5ul{{'-P, 0^)) = g ii and only if is a (5n-name of 
g and L G N satisfies (jlj) (regard the string O'^ as the constant function whose value is 0^). 

4.3.2. Complexity of the operator that solves differential equations. Now we can formulate 
the uniform version of Theorems 12.81 and 12.91 as follows (a proof will be given shortly). 

Theorem 4.10. LipIVP is (^dl, 5n)-FPSPACE-<^p-com^»/efe. 

As corollaries, we have Theorem 12.81 by Lemmas I3.11|[T] and 14.71 and Theorem 12.91 by 
Lemmas [XTMl and WM 

The following weaker version of Theorem 14.101 stated with the stronger reduction <^ 
from Definition 13. 5l[3l is slightly easier to prove (see the end of the section): 

Corollary 4.11. LipIVP is (5nL, fa)-FPSPACE-<^-com2)/ete. 

As we noted in Lemma 13.101 this is a more robust result in the sense that it is invariant 
under replacing representations to =-equivalent ones. A drawback is that Corollary 14. 1 1 1 does 
not directly yield Theorem 12. 9[ because Lemma [4.81 requires FPSPACE-<^p-completeness, 
whereas replacing <^p by <^ in the assumption of I3.12|[T] also changes <]^-p to <\ in the 
conclusion. We can still obtain Corollary 12.101 

The rest of the section is devoted to the proof of Theorem 14.101 The positive part 
{LipIVP G (5nL, fc)-FPSPACE) will be verified by checking that the proof of Theorem 12.81 
can be made uniform. For the hardness, we need to modify slightly the construction in the 
original proof of Theorem [23] (this modification is not needed if we only want Corollary 14. lip . 

Proof of Theorem \4.10[ computability. Given a ^oL-name (/I, 0^) of g, we need to find a 
(5n-name of h = LipIVP {g). Recall that p is a modulus of continuity of g, and 

\lip{Q\u,v)\ - /(M, H)| < 2-5 for each u.veTi (such that (M, {v}) G [0, 1] x [-1, 1]). 

It is easy to find a modulus of continuity v of h: let z/(n) = n + M, where M G N 
is any number such that the values of g always stay in [—2^^, 2^^]. For example, M = 
riog2(|[(^(£,+0/l,+0/l)l| + 1 + 2^(0))]. 

To obtain ip, we apply the forward Euler method with step size 2 ^ to the approximation 
of g with precision 2""^ (we will specify p and q shortly). That is, we define an approximation 
hp^q G C[0, 1] of h by letting hp,q{0) = and then defining hp^q on [2-pT,2-p{T + 1)], for 
each T = 0, . . . , 2^ — 1 inductively, to be linear with slope approximately g{2~PT, /i(2~^T)): 
formally, 

(12) ^,,(2~^T + At) = hp,q{2'''T) + Z\t|y^(0'?, m, v)}, < Z\t < 2"^ 

for some m, f G D with |m] = 2~pT and |f] = hp^q{2~PT). Obviously, we can compute such 
a function hp^q in space polynomial in p and q in the sense that there is Euler G FPSPACE 
such that {Euler (if) {QP,0'i,u)j = hp^qHuj) for every m G D. 

Let '?/'(0", u) = Euler{ip){OP, 0^, u), where p = max{/i(n + 8L), n + 8L + M} and q = n + 8L. 
We claim that (z7, ip) is a So-name of h (this proves the desired FPSPACE-computability, since 
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p and q are bounded polynomially in \ip\, fi and n, L). This means that \hp^q{t) — h{t)\ < 2 ^ 
for any t G [0, 1]. More strongly, we prove, by induction on T = 0, . . . , 2''' — 1, that 

(13) IV(t) -/i(t)| < 2-V^(*-i) 

for all t G [2^^T, 2^p(T + 1)]. We may assume (|T3|) for t = 2~^T as the induction hypothesis. 
The approximate value hp^q{2~PT + At) is defined by f|T2l) . whereas the true solution h satisfies 

l>2-PT+At 

(14) h{2-PT + At) = h{2-PT) + g{T, /i(r)) dr. 

J2-PT 

The error added by this approximation is 



Z\^[^(0^n,^;)]- / g{T,h{T))dr 
J2-PT 



< 4L2-V^(2-PT-i)^, 



(15) 
because 

(16) \MO^,u,v)j-g{T,h{r))\ 

< \ MO'',u,v)j-g{lul M)\ + \g{lul M) - g{T, M)\ + \g{T, M) - g{T, h{T))\ 

< 2-'' + 2-"-«^ + L|M -/i(r)| 

< 2-"-^^ + 2-"-^^ + - /i(2-PT)| + \h{2-PT) - /i(r)|) 

< 2-"-8^ + 2-"-^^ + L(2-V^(2--r-i) ^ 2-P2^-^) 

< L(2-"-s^ + 2-"-8^ + 2-"e^^(2--T-i) ^ 2-"-8^) < 4L2-"e^^(2--T-i)^ 

where the second, third and fifth inequalities come from p > fi{n + 8L), q > n + 8L, 
p > M + n + 8L, respectively. Using f[T5]) and the induction hypothesis, we compare f[T^ 
and ([T3D to obtain 

(17) I hp,qi2~PT + At) - h{2-PT + Z\t) | < 2-'^e^^(2-''T-i) ^ 4L2-''e''^^^~''^-'^ At 

as desired. □ 

For the hardness, the core part of the proof can be done by relativizing the argument 
for the non-uniform version [1(|]. Since the proof was by reduction from the problem qbf, 
we use the relativized version qbf^ from Lemma 13.81 Starting from QBF^, we follow the 
construction in [lo!. Lemma 4.1], which uniformizes and yields the following. Let l^;* be the 
representation of S* which encodes a finite string u by the constant function with value u. 
Let A be the set of non- decreasing functions from N to N, and let l\ be its representation 
defined by tA^f) = ^. 

Lemma 4.12. Let L G PSPACE. Then there are a second- order polynomial P and a function 
G G ([id, tA, ti7*, PmI'^'-'^I, PkI'^"'^'^]], Pir)-FP such that for each Lp G domL, A G A and u G E* , 
the function glj^'^ : [0, 1] x [—1, 1] — )■ M defined by g^'^{t, y) = G{(f, A, u, t, y) satisfies 

(1) ^^'^(0, y) = g^'\l, y) = for all y E [-1, 1]; 

(2) \gt'\t,yo) - g^'\t,yi)\ < 2-^(l"f)||/o - yi\ for any t G [0, 1] and yo,yi G [-1, 1]; 

(3) g^'^it,y) G dom LzpIVP, and h^'^ := LzpIVP{g^'^) satisfies h^'^{l) = 2-^(l^l'^)(l«l) ■ 

miu). 



Proof of Theorem 4-10 > hardness. Let F G FPSPACE. We need to show that F <^p 6^^ o 
LipIVP o Soi^. We may assume that F is a total function and that there is a second- 
order polynomial Q such that F{ip){v) has length exactly Qd'/'Ddf |) for all ip G Reg and 
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Figure 9. Widget for reducing FPSPACE to LipIVP. 



V G S*. There is L G PSPACE such that L{(f){v,0'^) equals the ith symbol of F{(f){v) for 
any (f G Reg, v e S* and i G {0, 1, . . . ,Q{\(f\){\v\) - 1}. Apply Lemma to this L to 
obtain the P and G, and let g"^'^ and h':^'^ be as in the Lemma. 

We define s (of Definition I3.5p by describing the real function g = SnL{s{{p)) G CL[[0, 1] x 
[— 1, 1]] for a given ip. It has Lipschitz constant 1. It will be straightforward to check that a 
fc-name (and hence a 5nL-name) of g can be FP-computed from ip. We write gu and hu for 
the g'^''^ and /i^''^ corresponding to this given (p and X{k) = 3k + 2. 

For each binary string v, let 

(18) = 1 - + ^^^^tl, l^ = c,T ^ 



2\v\ 22^1+2' ^^22|*'l+2' 

where v G {0, . . . , 21^' — 1} means v interpreted as an integer in binary notation. This divides 
[0, 1) into intervals [l^ , l^] indexed by f G {0, 1}*. We further divide the left half [/~, c„] into 
Qd'/'Dd^l) + 1 subintervals [/„,o,4,i], [lv,i,lv,2], [^v,Q(M)(\v\)-i,lQ{\<p\)i\v\)], [iv,Qi\'p\)iH)^'^^]y 
where 

(19) I., = - ^ = 0, 1, . . . , Qm{\v\). 

On each strip [lv,ijv,i+i] x [—1, 1], we define g by putting the copies of g(v,oi) as in Figure |9l 
Precisely, 

/ t 2m+ (-l)"*y\ _ 22lH+22^+i 

(20) 9 Uv,i + ^2\v\+22i+i' 2T<H0 ) ~ 27(kl,i) 9iv,o'){t, y) 

for each t G [0, 1] and m G N, ?/ G [— 1, 1], where the polynomial 7 is defined by 7(|f |, 0) = 
2|v|+3 and 7(|f |,z + l) = 7(|w|, z) + P(|9?|, A)(|(f , 0*)|) + 2. On the last strip [lv,Q{\v\)iH)^^^] ^ 
[— 1, 1], we define g to be constantly 0. On the right half [c^, /^], we define g symmetrically: 
g{l^ — t,y) = —g{l^ + t, y) for < t < 1/2^1^1+^. Because of this symmetry, the function 
h := LipIVP{g) takes value at each l^, and it can be verified, using of Lemma [4.121 
that for i = 0, . . . , Q(|(y9|)(|z;|) inductively, 

-1 /i(.ffl)(l) ^ -1 Hy,){v,0^) ^ ^L{^){v, 0^) 



2'>(I^I'J') j'r'o 2')'(K'IJ)2'P(I^I'^)(I{'''0')I) /To 2'^(I^IJ+i) 

In particular, the number h{c^) = /i(/„,q(|^|)(|^|)) = ^^^jlf l^^l''l^"ML((^)(t;, O^VS^^'"''^'^^^ con- 
tains the values L{(p){v,0^) for all j < Q{\(p\){\v\), from which we can recover F{ip){v). 
The reducing functions r and t (of Definition 13. 5p perform this lookup. That is, t{(p){v) = 
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(07(kl:Q(lvl)(kl))^^y) with I wj = Cy, and r{(f) is the function that, given the encoding of (an 
approximation of) h{cy), extracts the value F{ip){v). □ 



In lO, Theorem 3.2], the non- uniform version of Lemma 14.121 was used to construct a 
function that proved Theorem 12.91 We needed a different construction, because for our 
Theorem 14.101 (with the reduction <'^p), we needed to get the values L{ip){v,0^) for all 
j < Q{\ip\){\v\) in one query. For Corollarv 14.111 (with the reduction <w)) we are allowed 
to make many queries, so the straightforward uniformization (without stacking the copies of 
g{v,o') vertically) would have worked. 



5. Summary and future work 

To discuss computational complexity in the framework of TTE, we replace 17^, the 
infinite strings, by Reg, a class of functions from strings to strings. This is a gen- 



eralization in two ways: these functions (a) can have values of arbitrary length, and 



(b) take string arguments, rather than just unary strings. 

For time and space bounds we use second-order polynomials in the input size, which 
are defined in the way suggested by type-two complexity theory. We defined classes 
P, NP and FP, FPSPACE. With a suitable notion of polynomial-time reductions, we 
can also define NP- and FPSPACE-completeness. Formulating other classes is left for 
future work. 

To apply this to problems involving real numbers, we introduced representations pm, 



ijj(S) and (5n of real numbers, sets and functions. Both aspects (a) and (b) of our gen- 
eralization were useful. With respect to these representations, we showed that taking 
the convex hull of a set is NP-complete, and that solving a Lipschitz continuous ordi- 
nary differential equation is FPSPACE-complete. These are uniform versions of what 
have been known non- uniformly, and tell us more about the hardness of numerical 
problems in practice. An interesting direction for further investigation is to ask which 
other known non-uniform results about operators do (or do not) uniformize. One can 
also look at known computability results and ask whether analogous statements hold 
true for time- or space-bounded classes. 
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